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(57) ABSTRACT 

A method and system for inserting and examining Cookies 
in the data streams of HTTP connections for the purpose of 
persistently directing HTTP connections to the same desti- 
nation. The present invention enables a network transmis- 
sion device, e.g., a router or controller, to reliably and 
efficiendy direct subsequent HTTP connections from the 
same client to the same server (destination) for accessing the 
requested resources. There are four modes for employing the 
Cookie to persistently direct HTTP connections. The asso- 
ciative mode inserts a Cookie into an HTTP response that 
uniquely identifies the client so that when a client's subse- 
quent HTTP request is compared to a table, the HTTP 
request will be routed to a previously selected destination 
associated with the client The passive mode inserts Cookie 
information into an HTTP response that uniquely identifies 
a previously selected destination such as a node server so 
that when a client's subsequent HTTP request is examined, 
it will be provided to the previously selected destination. In 
the rewrite mode, a network transmission device manages 
the destination information that is rewritten over blank 
Cookie information generated by the destination producing 
the HTTP response. The insert mode enables a network 
transmission device to insert and remove Cookie informa- 
tion in the data packets for HTTP requests and responses 
prior to processing by the destination. The Cookie informa- 
tion can include a time stamp. Other types of Cookies 
include priority, path and hops. 

8 Claims, 15 Drawing Sheets 
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METHOD AND SYSTEM FOR STORING proxy cache to randomly assign a relatively small number of 

LOAD BALANCING INFORMATION WITH virtual client ip addresses to the currently "on-line" 

AN HTTP COOKIE (customers) clients. Typically, a proxy cache will assign one 

of the virtual client ip addresses to a client on a first available 

FIELD OF THE INVENTION 5 basis each time the client connects to the ISP and starts a 

This application relates generally to distributing the load °» me J"* 8 ™*; Fr0I \ the , discussion above it is 

demand between servers on a network, and, more apparent that when a chent u^ a large ISP to cormect to a 

specifically, to employing an HTTP cookie to balance the WAN such as the Internet, the prior art did not provide an 

load demand between servers on a wide area network of effectlve me u thod for V^etettOy °W8 a s rela " 

geographically distributed servers such as the Internet 10 honshl P to ma » was ***** to P rovide icoess to 

resources associated with a request. 

BACKGROUND OF THE INVENTION Therefore, it is desirable to provide a method and system 
Generally, it has proven difficult to reliably and efficiently for automatically providing a persistent mapping of a pre- 
load balance the demand for access to resources, e.g., a 1S vlousl y ^ected destination for a domain namer rp address 
web-based application, email and streamed multimedia data, 15 re£ ^ L raW * pre ^ "T-S^iT \ ^ 
on a wide area network (WAN)- One prior art attempt * a Hyper Text Transport Protocol (HTTP) data stream to 
employed a look up table for storing a relationship mapping ldenUfv \ T ^°^ T ^ cn 3 desU " 
between a client's ip address and the ip address of the actual Qatl0n a chent's HTTP request The present invention 
server that provided access to the resources for a domain on overcomes many of the limitations of the pnor art caused by 
name/ip address request This table was usually held in the 20 *? ma PP m S of ™ actual ^nation ip address to a 
memory of a server array controller that managed several clicnt s l P address - 

node servers that could provide access to the resources SUMMARY OF THE INVENTION 
associated with the client's request Typically, the server 

array controller would employ a load balancing technique to In accordance with the present invention, a method for 

select and map the ip address of one of the managed node load balancing access to a resource identified in an HTTP 

servers to the chent's actual ip address and store this mapped request The method includes: (1) examining an HTTP 

relationship with a time stamp in the table. In this way, when request to determine when a Cookie is included with the 

a client repeated an request before the expiration of the time HTTP request, the Cookie may include information that 

stamp, the controller would use the mapping stored in the 3Q indicates a destination for accessing the resource identified 

table to automatically connect the client to the previously in the HTTP request; (2) when the Cookie is included in the 

selected (load balanced) uode server. HTTP request, sending the HTTP request to the destination 

Additionally, if the time stamp had expired, the server that is indicated by the Cookie's information; (3) generating 

array controller would again perform the load balancing an HTTP response at the destination, the HTTP response 

technique to select one of the managed node servers to 35 providing access to the requested resource; (4) inserting a 

provide the actual access to the resources associated with the copy o f the information in the Cookie; and (5) sending the 

request Each time the load balancing technique was HTTP response with the co py of the information in the 

performed, the controller would update the table to include Cookie to the sender of the HTTP request, so that a subse- 

a new time stamp and a new mapping of the chent's unique quent HTTP request to access the resource will include 

ip address to the currently selected-node server's ip address. ^ another Cookie with information indicating that the resource 



For a relatively small number of client requests, the above 



is accessible at the destination. 



described prior art solution could reduce the demand on In accordance with other aspects of m e prese nt invention, 

server array controller resources because the controller did ^ method provides for sending the HTTP request to a 

not always have to perform a load balancing technique for server array controller that manages a plurality of node 

each client request that occurred before the expiration of the 4S servers. The server array controller select s one of the plu- 

time stamp. Instead, the controller only performed the load rality of node servers to receive the HTTP request based on 

balancing technique for a new client request or when the the information in the Cookie. The selected node ser ver is 

time stamp for a previous client request was expired. associated with the destination and generates the HTTP 

However, since all of the table entries had to be kept in the response that includes the copy of the information in the 

memory of the server array controller to be used effectively, 50 Cookie. 

the available controller resources for load balancing and In accordance with yet other aspects of the present 
managing several node servers decreased in proportion to an invention, the method provides for including an identifier 
increase in the number of client requests. To ensure that table with the copy of the information in the Cookie. The identifier 
entries were not lost when the server array controller lost associates the selected node server with the destination. The 
power or was rebooted, a copy of the table would be stored 55 identifier may be encoded by a mathematical product such as 
on a secondary storage medium. Also, under heavy load a hash value. Also, a time stamp may be generated by the 
conditions, the secondary storage medium was often not fast node server, server array controller or any network trans- 
enough to store the copy of table entries before the server mission device and included in the HTTP response, 
array controller shut down. In accordance with additional aspects of the present 
Another significant problem with the prior art approach 60 invention, the method provides for employing a selected 
was that the chent's ip address was not always unique. node server to generate the HTTP response and includes a 
Although some clients might have their own unique ip blank identifier in the copy of the information in the Cookie, 
address, many others used random virtual client ip addresses In this case, the server array controller may write the 
provided by a large Internet Service Provider (ISP), e.g., the identifier over the blank identifier in the copy of the infor- 
America On-line Corporation, to connect to the Internet. 65 mation in the Cookie. The method may also provide for 
Since only a portion of a large ISP's clients are typically changing an expiration date for the time stamp relative to the 
connected at any one time, a large ISP usually employs a number of HTTP requests sent to the server array controller 



02/04/2004, EAST Version: 1.4.1 



US 6,374300 B2 

3 4 

over a period of time. The expiration date for the time slamp request, comprising: (1) examining an HTTP request to 

can be increased when the number of HTTP requests sent to determine when a Cookie is included with the HTTP request, 

the server array controller are greater than a determined the Cookie including information that identifies a sender of 

value over a period of time. Alternatively, the expiration date the HTTP request; (2) 

for the time stamp may be decreased when the number of 5 when the Cookie is included in the HTTP request, corn- 
HTTP requests sent to the server array controller arc less paring the information identifying the sender to a table 
than a determined value over a period of time. of at least one destination, the HTTP request being sent 
In accordance with other aspects of the present invention, to a destination that is associated with the identified 
the method provides for employing the server array control- sender in the table; (3) 

ler to select one of the plurality of node servers to receive the 10 generating an HTTP response at the destination, the HTTP 

HTTP request and generate the HTTP response providing response providing access to the requested resource and 

access to the requested resource when the Cookie is not including a copy of the information in the Cookie; and 

included in the HTTP request. The present invention pro- (4) sending the HTTP response with the copy of the 

vides for sending an HTTP response to the sender of the information in the Cookie to the identified sender of the 

HTTP request with information for creating another Cookie, 1S HTTP request, so that a subsequent HTTP request to 

so that a subsequent HTTP request to access the resource access the resource from the identified sender will 

will include the other Cookie with information indicating include another Cookie with information that identifies 

that the selected node server is the destination for accessing the sender of the subsequent HTTP request, 

the requested resource. In accordance with other aspects of the present invention, 

In accordance with still other aspects of the present 20 the other method provides for employing a server array 

invention, the method provides for employing the server controller that manages a plurality of node servers. The 

array controller to balance the load demand on the plurality server array controller comparing the information identify- 

of node servers by determining the optimal node server to ing the sender to a destination that is associated with the 

receive the HTTP request and generate the HTTP response. identified sender in the table. The destination can be one of 

The server array controller may employ one of a plurality of 25 the node servers managed by the server array controller, 

functions to determine the optimal node server to balance In accordance with yet additional aspects of the present 

the load demand. These functions include round trip time, invention, a system which implements substantially the 

round robin, least connections, packet completion rate, same functionality in substantially the same manner as the 

quality of service, server array controller packet rate, methods described above is provided 

topology, global availability, hops, static ratio and dynamic 30 In accordance with other additional aspects of this 

ratio. invention, a computer-readable medium that includes 

In accordance with additional aspects of the present computernexecutable instructions may be used to perform 

invention, until the HTTP request is provided to the server substantially the same methods as those described above is 

array controller, the method provides for employing the 35 provited- 

server array controller to buffer communication between the BRIEF DESCRIPTION OF THE DRAWINGS 
sender and the destination. Also, when the HTTP request is 

provided to the server array controller, replaying in con- The foregoing aspects and many of the attendant advan- 

secutive order the buffered communication to at least one of tages of this invention will become more readily appreciated 

the plurality of node servers that is associated with the as the same become better understood by reference to the 

destination. following detailed description, when taken in conjunction 

In accordance with other aspects of the present invention, ™& ^ accompanying drawings, wherein: 
a plurality of Cookies may be included with the HTTP FIG. lAis a schematic overview of a system for process- 
request Each Cookie can have a different type that indicates ing an HTTP request that does not include a Cookie; 
how the information included in a Cookie is to be utilized. 45 FIG. IB is a schematic overview of a system for process- 
The different types of Cookie include priority, path and hops. ing an HTTP request that does include a Cookie; 
The path type of Cookie includes information indicating all FIG. 2A is a flow chart showing an overview for process- 
of the interim destinations between the sender and the m g a n HTTP request that does not include a Cookie; 
destination for an HTTP request. The interim destinations pj G 2 B is a flow chart illustrating an overview for 
include a router, host machine, server array controller, 50 processing an HTTP request that does include a Cookie; 
firewall, node server and client. The hops type of Cookie ^ ^ a flow ^ &how{ &Q modc for 
includes information indicating a portion of the interim ^ an t that does not ^tob a Cookic; 
destinations between the sender and the destination for an ™„ . „ , M1 . . . , - 
HTTP request. The priority type of Cookie includes infer- FIG.3B isa^hart lUustratmgan associative : mode for 
mation indicating when the HTTP request and/or response 55 Processing an HTTP request that does include a Cookie; 
associated with the Cookie is to be processed prior to the 4A is a flow chart showing a passive mode for 
processing of other HTTP communications. The priority processing an HTTP request that does not include a Cookie; 
type of Cookie may include an indication that identifies a FIG. 4B is a flow chart illustrating a passive mode for 
priority for processing the HTTP request and/or response processing an HTTP request that does include a Cookie; 
prior to the processing of the other HTTP communications. ^ FIG. 5 A is a flow chart showing a rewrite mode for 

In accordance with yet other aspects of the present processing an H IT V request that does not include a Cookie; 

invention, wherein the sender may include a client, server FIG. SB is a flow chart illustrating a rewrite mode for 

and host machine. Also, the destination can include a host processing an HTTP request that does include a Cookie; 

machine, server array controller, router, node server, firewall FIG. 6A is a flow chart showing an insert mode for 

and client. 65 processing an HTTP request that does not include a Cookie; 

In accordance with the present invention, another method FIG. 6B is a flow chart illustrating an insert mode for 

for load balancing access to a resource identified in an HTTP processing an HTTP request that does include a Cookie; 
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FIGS. 7A-7C show exemplary code fragments of HTTP the requested URL against all of the URLs stored in the 

requests that include Cookies; client's Cookies. If the requested URL matches any of the 

FIGS. 7D and 7E illustrate exemplary code fragments of stored URLs, a line contaimng the name/value pairs of all 

HTTP responses that include information for setting Cook- match ? « ^9 ^ * inducted intheHTTP request An 

ies at the Anders of the associated HTTP requests; 5 exemplary line in a Cookie for an IfTTP request could I be 

^ included as follows: Cookie: NAMEl=OPAQUE_ 

FIG. 8 shows the buffering of communication between a STRING1; NAME2=OPAQUE_STRING2. 

client and a node server by a proxy server; and \ Cookie is typically used to save the state of a relation- 

F1G. 9 illustrates an exemplary computer system for the ship between a client and a server. However, in some cases, 

client. 10 the saved state of the relationship may create a bad balanc- 
ing problem. For example, each node server that is managed 

DETAILED DESCRIPTION OF THE by a load balancing server array controller may not always 

PREFERRED EMBODIMENT share the same state relationship with the client that is saved 

_ 4 . . 4 . 4 . ^. , in the Cookie. In this case, the controller must persistendy 

- • The L ^^ T n ,k , ^r S^D eXam " «nd * repeated client HTTP request to the same node server 

ining HTTP Cookies in the data streams of HTTPoonnec- 1S 5ecause ^ difficult t0 recrea £ ^ ^ ^ relationship 

Uons for the purpose of persistently directmg HTTP con- m another dur{ng the HTTP request/response session. 

nections to the same destination. The present invention Although the saved state relationship in a Cookie can 

enables a network transmission device, e.g., a router, to crcatc a bad balanc ; ng problem, the present invention uses 

reliably and conveniently direct subsequent HTTP connec- me Co 0 ki e mechanism to offer a solution to this problem by 

tions from the same client to the same server for accessing 2 n enabling a network transmission device, e.g., a switch, 

requested resources. Internet router, and/or a server array controller, to insert 

HTTP is an application level protocol for transferring and/or examine Cookies in the data streams of HTTP 

resources across the Internet, e.g., a network data object or connections for the purpose of reliably, conveniently and 

server, and it is specified by the URL. The Hyper Text persistendy directing connections to the same destination, 

Mark-up Language (HTML) is a simple data format that is 25 e.g., a node server. Preferably, the network transmission 

used to create hypertext documents that are supported by the device actively inserts data into or modifies the HTTP data 

HTTP protocol. Together, these standards have contributed stream from a server so that a Cookie can be saved by the 

to create the World Wide Web (WWW) on the Internet. The client indicating the state relationship between the client and 

WWW is a globally accessible and platform-independent the server. In this way, the transmission device can use the 

hypermedia information system that has become a central 30 Cookie returned in a subsequent client HTTP request to 

access point to applications and services for people around direct the current connection to the same server. 



the world. 



System Overview 



A Cookie is a general mechanism, i.e., protocol, which . * *™ A c *u j * 

server side connections can use to both store and retrieve „ 9/ ^ tes a ^ m ° ve ™ ew 100A of 
information on the client side of the connection. The addi- 35 *™ &>f *° ^TTP request/response for accessing resources 



lion of a simple, persistent, clieot-side state significantly associated with a domain name resoWed into an Internet 
extendsthecapabilitiesoflntemet-basedclient/serverappli- P™ 1 <™ 1 (*> addr « ° r « * ^dress that is directly pro- 
cation programs. A server, when returning a HTTP object to Vlded b y a chen < }?■ In *> s *° cl f 1 *? t . artS a 
a client, may also send a pieceof state information which the ™* 10D "JSP 102 (located in Chicago 
client may store. Included in that state object is a description 40 N-) 8 ~f ™» u ° n " ed " ,m - ? ° T f, am P le ' ***** 
of the range of Uniform Resource Locators (URLs) for mav to * e lot f "f P a ^ont modem, 
which the returned state is valid. Any future HTTP requests cable modem and/or satellite connectton. The local ISP 102 
made by the client which fall in that range will include a P Tavldes a . tocal domain name system (DNS) ^server 
transmittal of the current values of the state object form the 106 , tbat communicates with other servers on the WAN for 
client back to the sender. This state object is called a « tesolvmg a d^omain name request mto an ip address when the 
"Cookie," for no compelling reason. client provides a domain name for accessing resources. 

„ , . . . . , . , , ,. , The client 10 sends an HTTP request 108A to the local 

The Cookie mechanism provides a powerful tool that ,„„ . . n . . . 

enables different types of application progmns to be written f, 102 for access to resources abated with an ip address 

for Internet-based 1 environments. For example, a service f at ^.f^. Ksolv f ° r P ro ^ d Aproxy server 

. 11M , ^ , • frt cginA . K ' „• r ^ t - „ so 104 will assign and add its first available virtual client ip 

program could use a Cookie to send back registration 3U . t \ rrTn . ino . . ,. . ift . 

f -° , . - .j. address to the HTTP request 108A, so that the client 10 is 

information and free the client from retyping a user identi- 77 77 ri ~T . \l ^ \ . T * T_ . 

« . . f . . v • Ai identifiable during the current session. In the case where the 

fication number for each connection to the service. Also, an » iSoa -j »•* j -.j 

, « 4 •« ,j . c ^ r . j HTTP request 108A identifies a domain name associated 

Internet site could store user preferences for a client and ... 4t . • c jj *u 1 1 fimp 

, ■ 1 • , . r r u ** *u ♦ *u wtlh me resource instead of an ip address, the local DNS 

have the client supply those preferences each time that the ^ nt . . 4 4 j , 4 . 4 . fc . 

r , 4 , / \c . t * 55 server 106 employs a distributed database to resolve the 

client connected to the site. " , . . *\ *. . . , r . . 

_ „ „ t . . . , , , , . , J domain name into the ip address for the requested resource. 

Generally, > Cookie k mtroduced to the client by includ- the HTTP request 108Aover 

ing mformauonw,th a Set-Cookie command I m a header as m tQ a da(a ^ m m SeaU , 

partofenmTOres^Anexamp^ Wasfa which ^ idemified t0 be associated with the 

command included in an HTTP response header is listed ^ Kqwsted domain ^ ^ or ip ^dnss. A 

ow ' router 114, (optional) firewall 116, server array controller 

<HEADER> and an intranet 0 f ^ 00 de servers 120 are disposed at the 

Set-Cookie: NAME-VALUE; expires- DATE; data center 112. The server array controller 118 is used to 

path=PATH; domain=DOMAIN_NAME; secure manage and load balance network traffic on the intranet of 

</HEADER> 65 node servers 120. 

When a client's browser program is requesting a URL In one embodiment, the server array controller 118 intel- 

from an HTTP server on the Internet, the browser will match ligently distributes web site connections across arrays 
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(pools) of node servers, transparent firewalls, transparent 
cache servers, routers as well as other router-like devices. 
The controller 118 may manage connections to multiple 
Internet or intranet sites, and it can support a wide variety of 
Internet protocols and services such as TCP/IP (transmission 
control protocol/Internet protocol) and HTTP. It is under- 
stood that the TCP/IP protocol actually represents a suite of 
communications protocols that are used to connect hosts on 
the Internet. 

Each node server is defined by a specific combination of 
a node address and a node port number on the intranet 
behind the server array controller 118 which can monitor 
several aspects of the node servers. The controller 118 can 
load balance each connection to the intranet of node servers 



10 



with information included with a SET_COOKIE command 
that enables the particular ip address of the selected node 
server to be identified. Depending upon the mode of the 
present invention that is selected, the SET_COOK3E com- 
mand may be inserted in the header of the HTTP response 
by the server array controller 118 and/or the selected node 
server. Next, The logic moves to an end block and termi- 
nates. 

FIG. 2B shows an overview 132 for processing an HTTP 
request that includes a Cookie with information that can be 
used to identify the destination that was previously selected 
to provide access to the requested resources. Moving from 
a start block, the logic steps to a block 134 where a TCP/IP 
handshake is performed between the client 10 and the server 



by selecting a unique ip address for a node server to provide 15 array controller 118 associated with the node server identi- 



optimal access to a requested resource. 

The selected node server will provide access to the 
requested resource in an HTTP response that is sent by the 
server array controller 118 over the Internet 110 to the virtual 
client ip address at the Local ISP 102. The HTTP response 
includes a SET_COOKJE command in the header of the 
response which includes information identifying the actual 
node server on the intranet behind the server array controller 
118. The client accesses the requested resource in the HTTP 
response received from the Local ISP 102. 

FIG. IB illustrates a system overview 100B of substan- 
tially the same data stream flow as shown in FIG. 1A. Except 
that the client 10 is providing an HTTP request 108B which 
includes a Cookie uniquely identifying a relationship 
between the previously selected node server and the client 
requesting access to the resource. So long as the Cookie is 
not expired, the server array controller 118 will automati- 
cally direct the HTTP request to the destination (node 
server) identified by the information in the Cookie. Thus, the 
server array controller 118 can use the information in the 
Cookie to reliably and efficiently load balance client 
demands for access to requested resources. 

Logic Overview 

In FIG. 2A, an overview 122 is shown of the general logic 
flow for an HTTP request that does not include a Cookie 
identifying the actual node server that will provide access to 
the requested resource. Moving from a start block, the logic 



20 



25 



fied in the Cookie. Advancing to a block 136, the client 10 
transmits the HTTP request to the server array controller 118 
along with the Cookie and its information. The logic flows 
to a block 138 where the server array controller 118 uses the 
information included in the Cookie to route the HTTP 
request directly to the ip address of the node server that was 
previously selected to provide access to the requested 
resources. 

Next, the logic moves to a block 140 where the selected 
node server generates an HTTP response for accessing the 
requested resources and provides this HTTP response to the 
server array controller 118. The controller 118 retransmits 
the HTTP response to the client 10 along with a SET- 
COOKIE command that includes information that can be 
used to identify a relationship between the client and the 
destination (node server) that will provide access to the 
requested resources. The logic moves to an end block and 
terminates. The present invention thus enables the server 
array controller 118 to use the information in the Cookie to 
quickly, reliably and efficiently load balance client demands 
for access to requested resources. 

Although not shown, another embodiment of the present 
invention enables the server array controller 118 to vary the 
expiration date of the time stamp included with HTTP 
requests and responses. When the load demand on the server 
array controller 118 increases, the controller may increase 
the period of time (expiration date) before the time stamp 
expires. Alternatively, when the load on the server array 



steps to a block 124 where a TCP/IP handshake is performed 4S controller 118 decreases, the controller may decrease the 



between the client 10 and the server array controller 118 at 
the ip address provided by the client Advancing to a block 
126, the client 10 transmits the HTTP request to the server 
array controller 118 without a Cookie identifying the node 
server that will provide access to the requested resource. 

Flowing to a block 128, the server array controller 118 
makes a load balancing determination and selects the opti- 
mal node server to provide access to the requested resource 
and routes the HTTP request to the selected node server. The 



50 



period of time before the time stamp expires. By varying the 
expiration dates of the time stamps, the server array con- 
troller 118 may control the number of times that the con- 
troller performs load balancing determinations within a 
period of time. Also, when only a few destinations can 
provide access to the requested resource, the server array 
controller 118 may set the time stamp expiration date to one 
year or more. 

The present invention provides at least four different 



server array controller 118 may employ any one of several 55 modes of operation for inserting information in an HTTP 



different types of load balancing methods to analyze metric 
information and optimally balance client HTTP requests 
(load demand). These load balancing methods include round 
trip time, round robin, least connections, packet completion 
rate, quality of service, server array controller packet rate, 60 
topology, global availability, hops, static ratio and dynamic 
ratio. 

Stepping to a block 130, the selected node server gener- 
ates an HTTP response thai enables the client 10 to access 

the requested resource. The selected node server transmits 65 trated. Moving from a start block, the logic steps to a block 
the generated HTTP response to the server array controller 144 where a TCP/IP handshake is performed between the 
118 which retransmits the response to the client 10 along client 10 and the server array controller 118 at the ip address 



response and examining Cookies in an HTTP request for 
uniquely identifying a relationship between the client and a 
selected destination such as a node server to provide access 
to the requested resources. These modes of operation include 
associative, passive, rewrite and insert. 

Associative Mode 

In FIG. 3 A, an overview 142 of an "associative" mode for 
processing an HTTP response without a Cookie is illus- 



02/04/2004, EAST Version: 1.4.1 



US 6,374,300 B2 

9 10 

provided by the client. Advancing to a block 146, the client Alternatively, in another embodiment, the node server 

10 transmits the HTTP request to the server array controller could include a SET_COOKIE command with blank infor- 

118. mation in the generated HTTP response. In this case, the 

The logic flows to a block 148 where the server array server array controller 118 would rewrite the blank infor- 

controller 118 receives the HTTP request and makes a load 5 mation to include other information that uniquely identifies 

balancing determination to select the optimal node server to the client 10 requesting access to the resources at the ip 

provide access to the requested resource. After selecting the address of the selected node server. 

°u Ptim 4U 0dC Xim ' ^ ^T 0 *?™! °° ntrollcr 118 routCS In summary, the associative mode provides for inserting 

me HTTP request to me seated node server. f ^ ^ re ^ ^ { ^tites the 

Tlie logic steps to ablock 150 where the selected node 10 client M ^ whea a c]icnVs ^ t t fa 

server generates an HTO response that provides acce^ to CQm d tQ a ^ ^ ^ qucn t HTTP request will be 

the requested resource. The selected node server transmits K , , 4 . . 1 7 j j *• Vl 

the HTTP response to the server array controller 118. The P™** ° a P*™^ xltcted desbMll ° I !i ™' ^ XDt 

server anaycontroller 118 inserts a SCT_COOKIE com- " ve ° hon ««Wes the «rver array controUer 118 to use 

mand with information uniquely identifying the client 10 *e irformahon m the ^kie to 

into the HTTP response's header. The controUer 118 retrans- 15 f ° r ■«?» ° req««^ resources. AddaUonaUy , u is under- 

mils the HTTP response and the Cookie information to the stood «"» ^? at,ve I ° ode P ute most of ^ load *> r 

client 10 processing an HTTP request on the server array controller 

"... | j . . , , 118 relative to the load placed on a previously selected node 

c^*™^' SClCC i Cd ?k ™ r m " S C *™ that is managed by the controller. 

SET_COOKIE command m the HTTP response's header 20 6 7 

with blank information. In this case, the server array con- Passive Mode 
trailer 118 rewrites this blank information with information 

that uniquely identifies the client 10 and retransmits the In FIG. 4A, anoverview 172 of a "passive" mode for 

"rewritten" HTTP response to the client. processing an HTTP request/response is illustrated. Moving 

Next, the logic flows to a block 152 where the server array 2S from a start block ' toe lo & c ste P s to a block 174 where a 

controUer 118 maps the identified client and the ip address TCp / n> handshake is performed between the client 10 and 

of the selected node server into a table that is stored in the toe *™ arra y controller 118 at the ip address provided by 

memory of the controUer. Toe logic moves to an end block toe clienl - Advancing to a block 176, the client 10 transmits 

and terminates. Additionally, it is understood that the SET_ toe HTTP request to the server array controUer 118. 

COOKIE command causes the client to store the Cookie 30 The logic flows to a blo ck 17 8 where the server array 

information that uniquely identifies the client, so that when controUer 118 receives the HTTP request and makes a load 

the same HTTP request is repeated by the client, this stored balancing determination to select the optimal node server to 

Cookie information will be used to create a Cookie that is provide access to the requested resource. After selecting the 

included with the repeated HTTP request. optimal node server, the server array controUer 118 provides 

FIG. 3B shows an overview 154 of an "associative" mode 35 toe HTTP request to the selected node server. The logic steps 
for processing an HTTP request that includes a Cookie with to a block 180 where toe selected node server generates an 
information that can be used to identify the client 10. The H'lTF response that includes Cookie information identifying 
Cookie for an HTTP request may be provided from a toe selected node server, i.e., a SET COOKIE command is 
previous HTTP request/response exchange as illustrated in inserted into the header of theHTTP response. The selected 
FIG. 3A above. It is also envisioned that another facility may -40 node server provides the HTTP response along with the 
be employed to create a Cookie for the HTTP request that inserted Cookie information to the server array controller 
includes information identifying the client 10. In this 118. The server array controUer 118 provides the HTTP 
example, the information included in the Cookie enables the response with the Cookie information to the client 10. Next, 
server array controller 118 to uniquely identify the client 10 tbe log ic moves to an end block and terminates, 
and a mapped relationship to a previously selected node 45 Additionally, it is understood that the SET_COOKIE corn- 
server. Moving from a start block, the logic steps to a block mand causes toe clie nt to store Cookie information that 
156 where a TCP/IP handshake is performed between the identifies the previously select ed de stination, e.g., a node 
client 10 and the server array controUer 118 at an ip address server, so that when the same HTTP request is repeated by 
provided by the client. Advancing to a block 158, the HTTP toe client, this stored Cookie information will be us ed to 
request along with the Cookie is transmitted from the client 50 crcatc a Cookie that is included with the repeated HTTP 
10 to the server array controller 118. request. 

The logic will move to a block 162 where the server array PIG- 4B sho ws an overview 182 of a "passive" mode for 

controUer 118 wiU access the table held in its memory and processing an HTTP request that includes a Cookie with 

identify the mapped relationship between the client and the information identifying a previously selected node server for 

previously selected node server for accessing the requested 55 providing access to requested resources. Moving from a start 

resources. Using the mapped relationship in the table, the block, the logic steps to a block 184 where a TCP/IP 

controUer 118 wiU provide the HTTP request to the previ- handshake is performed between the cUent 10 and the server 

ously selected node server. The logic flows to a block 168 ^ay controller 118 at the ip address provided by the client, 

where the node server generates an HTTP response which Advancing to a block 186, the HTTP request along with the 

includes a SET_COOKIE command with information that 60 Cookie is transmitted from the client 10 to the server array 

can be used to uniquely identify the ctient 10 requesting controUer 118. 

access to the resources at the ip address of the selected node The logic moves to a block 190 where the server array 

server. The logic moves to a block 170 where the server controUer 118 wiU use the information included in the 

array controUer 118 updates another time stamp stored in the Cookie to provide the HTTP request to the previously 

table which is associated with the mapping of the relation- 65 selected node server. The logic steps to a block 194 where 

ship between the client and the selected node server. Next, the selected node server generates an HTTP response includ- 

the logic moves to an end block and terminates. ing Cookie information that identifies the selected node 
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server. The selected node server provides the HTTP 
response with the Cookie information to the server array 
controller 118. The server array controller 118 retransmits 
the HTTP response with the Cookie information to the client 
10. Next, the logic moves to an end block and terminates. 

In summary, the passive mode provides for inserting 
Cookie information into an HTTP response that uniquely 
identifies a previously selected destination, such as a node 
server, so that when a client's subsequent HTTP request is 
examined, it can be efficiently provided to the previously 
selected destination. The present invention thus enables the 
server array controller 118 to use the information in the 
Cookie to load balance client demands for access to 
requested resources. Also, the passive mode puts most of the 
load for processing an HTTP request on a node server 
relative to the load placed on a server array controller 118 
managing the node server. 

Rewrite Mode 

Id FIG. 5 A, an overview 200 of a "rewrite" mode for 
processing an HTTP response is illustrated. Moving from a 
start block, the logic steps to a block 202 where a TCP/IP 
handshake is performed between the client 10 and the server 
array controller 118 at the ip address provided by the client. 
Advancing to a block 204, the client 10 transmits the HTTP 
request to the server array controller 118. 

The logic flows to a block 206 where the server array 
controller 118 receives the HTTP request and makes a load 
balancing determination to select the optimal node server to 
provide access to the requested resource. After selecting the 
optimal node server, the server array controller 118 routes 
the HTTP request to the selected node server. The logic steps 
to a block 208 where the selected node server generates an 
HTTP response that includes blank Cookie information, i.e., 
a SET__COOKIE command is inserted into the header of the 
HTTP response without information identifying the selected 
node server. The selected node server provides the HTTP 
response with the blank Cookie information to the server 
array controller 118. The logic moves to a block 210 where 
the controller 118 rewrites the blank Cookie information to 
identify the node server selected to provide access to the 
requested resources. The server array controller 118 trans- 
mits the HTTP response and the rewritten Cookie informa- 
tion to the client 10. Next, the logic moves to an end block 
and terminates. 

FIG. 5B shows an overview 212 of a "rewrite" mode for 
processing an HTTP request that includes a Cookie with 
information for identifying a node server previously selected 
to provide access to the requested resources. Moving from 
a start block, the logic steps to a block 214 where a TCP/IP 
handshake is performed between the client 10 and the server 
array controller 118 at an ip address provided by the client. 
Advancing to a block 216, the HTTP request along with the 
Cookie is transmitted from the client 10 to the server array 
controller 118. 

The logic will move to a block 220 where the server array 
controller 118 will use the information included in the 
Cookie to identify the previously selected node server and 
route the HTTP request to this node server. The logic steps 
to a block 224 where the selected node server generates an 
HTTP response that includes blank Cookie information. The 
selected node server provides the HTTP response along with 
the inserted blank Cookie information to the server array 
controller 118. The logic steps to a block 226 where the 
server array controller 118 rewrites the blank Cookie infor- 
mation to include other information that identifies the 
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selected node server. Next, the logic moves to an end block 
and terminates. 

In the rewrite mode, the server array controller 118 
manages the other "destination" information that is rewritten 

5 over the blank Cookie information. The rewrite mode 
roughly divides the load for processing an HTTP request/ 
response between a server array controller 118 and a 
selected node server that is managed by the controller. The 
rewrite mode places a portion of this load on the selected 

J0 node server to insert the blank Cookie in an HTTP response 
and another portion of this load on a server array controller 
118 for rewriting the blank Cookie information to include 
other information that identifies the selected destination 
(node server). One advantage of the rewrite mode is that a 

15 plurality of node servers managed by the server array 
controller 118 may have the same content related to inserting 
blank Cookie information into an HTTP response. In this 
way, updates to the plurality of node servers are more easily 
provided because each node server can have the same 

20 content Also, since the other information identifying the 
destination will occupy the same space as the blank Cookie 
information that was written over, the actual data packet 
containing the HTTP response does not have to change in 
size. 

25 

Insert Mode 

In FIG. 6A, an overview 228 of an "insert" mode for 
processing an HTTP request/response is illustrated. Moving 

5Q from a start block, the logic steps to a block 230 where a 
TCP/IP handshake is performed between the client 10 and 
the server array controller 118 at the ip address provided by 
the client. Advancing to a block 232, the client 10 transmits 
the HTTP request to the server array controller 118 at the 

3S primary ip address. 

The logic flows to a block 234 where the server array 
controller 118 receives the HTTP request and makes a load 
balancing determination to select the optimal node server to 
provide access to the requested resource. The server array 
controller 118 provides the HTTP request - to the selected 
node server. The logic steps to a block 236 where the 
selected node server generates an HTTP response and pro- 
vides the generated HTTP response to the server array 
controller 118. The logic moves to a block 238 where the 

45 server array controller 118 rewrites the data packers) con- 
taining the HTTP response so that Cookie information 
identifying the node server selected to provide access to the 
requested resources can be inserted into the data packet. The 
logic flows to a block 240 where the server array controller 

50 118 provides to the client 10 the rewritten data packet that 
includes the HTTP response and the inserted Cookie infor- 
mation. Next, the logic moves to an end block and termi- 
nates. 

FIG. 6B shows an overview 242 of an "insert" mode for 
55 processing an HTTP request that includes a Cookie with 
information identifying a node server previously selected to 
provide access to the requested resources. Moving from a 
start block, the logic steps to a block 244 where a TCP/IP 
handshake is performed between the client 10 and the server 
60 array controller 118 at an ip address provided by the client. 
Advancing to a block 246, the HTTP request abng with the 
Cookie is transmitted from the client 10 to the server array 
controller 118. 

The logic wuT move to a block 250 where the server array 
65 controller 118 will use the information included in the 
Cookie to identify the previously selected node server. The 
server array controller 118 will rewrite the data packet(s) 
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containing the HTTP response. The server array controller 
118 will provide the rewritten data packers) containing the 
HTTP response to the client 10. The logic steps to a block 
254 where the selected node server generates an HTTP 
response and provides the HTTP response to the server array 
controller 118. The logic moves to a block 256 where the 
server array controller 118 rewrites' the data packers) con- 
taining the HTTP response to insert Cookie information into 
the response's header for identifying the node server 
selected to provide access to the requested resources. The 
logic flows to a block 258 where the server array controller 
118 transmits to the client 10 a rewritten data packet that 
includes the HTTP response and the newly inserted Cookie 
information. Next, the logic moves to an end block and 
terminates. 

The insert mode enables a server array controller 118 to 
load balance client demands for access to requested 
resources by inserting and removing Cookie information in 
the data packets for HTTP requests and responses prior to 
processing by the destination (selected node server). In the 
insert mode, all of the load for inserting and examining 
Cookie information and rewriting data packets is placed on 
the server array controller 118 and none of this load is put 
on the node servers managed by the controller. 

Exemplary Cookie Code Fragments 

In FIGS. 7A-7E, exemplary embodiments of HTML code 
fragments are shown that illustrate Cookie information 
included with an HTTP request/response. FIG. 7A shows an 
exemplary code fragment for an HTTP request 260 that 
includes Cookie information identifying a server that pre- 
viously provided access to the requested resources. FIG. 7B 
illustrates an exemplary code fragment for an HTTP request 
262 that contains blank Cookie information that does not 
identify the client 10 or a previously selected destination 
such as a node server. FIG. 7C shows an exemplary code 
fragment for an HTTP request 264 that includes Cookie 
information identifying the client 10 that previously 
requested access to the requested resources. FIG. 7D illus- 
trates an exemplary code fragment for an HTTP response 
266 that includes Cookie information identifying a server 
that previously provided access to the requested resources. 
FIG. 7E shows an exemplary code fragment for an HTTP 
response 267 that includes Cookie information identifying 
the client requesting access to the resources provided by the 
server. 

Proxy Server Buffering 

FIG. 8 illustrates an overview of how certain data packets 
between the client and a selected node server 274 are 
buffered and replayed by a server array controller's proxy 
server 270. A rectangular graphical representation of the 
proxy server 270 is vertically disposed along the center 
portion of this figure. Also, positioned along the center line 
of the developed length of the proxy server 270 is a time line 
271 that starts with an initial value of "zero" near the top of 
the graphical representation of the proxy server. On the left 
side of the proxy server 270 is a graphical representation of 
a client 272 transmitting and receiving data packets along 
the developed length (and time line 271) of the proxy server. 
Similarly on the right side of the proxy server 270 is a 
graphical representation of a node server 274 transmitting 
and receiving data packets along the developed length of the 
proxy server. 

Starting at the top left side of the figure, the client 10 is 
transmitting and receiving three separate groups of data 
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packets with the proxy server 270. First, a TCP SYN 276A 
data packet is transmitted from the client 272 to the proxy 
server 270, which is followed by an exchange of TCP 
SYN/ACK.ACK 278A data packets. Next, a HTTP 

5 REQUEST 280A data packet is transmitted to the proxy 
server by the client 

All three groups of data packets are buffered and stored by 
the proxy server 270 until the HTTP REQUEST 280A is 
received by the proxy server. Then, the server array con- 

10 troller will examine the data packers) associated with the 
HTTP REQUEST 280A to determine if it includes Cookie 
information that identifies the client and/or a destination that 
previously provided access to the requested resources. 
Once the Cookie determination is made, the proxy server 

15 270 will sequentially replay the transmitting and receiving 
of the three groups of data packets with the selected node 
server 274. On the right side of the graphical representation 
of the proxy server 270, these three groups of data packets 
are replayed between the proxy server 270 and the node 

20 server 274. First, a TCP SYN 276B data packet is transmit- 
ted from the proxy server 270 to the node server 274, 
followed by an exchange of TCP SYN/ACK.ACK 278B 
data packets and next a HTTP REQUEST 280B data packet 
is transmitted to the node server 274 by the proxy server 270. 

25 Moving further down the length of the graphical repre- 
sentation of the proxy server 270, a data packers) for an 
HTTP RESPONSE 282 A is provided to the proxy server 270 
by the selected node server 274. The proxy server 270 
immediately replays this data packet to the client 272 in 

30 HTTP RESPONSE 282B. Next, the client 272 exchanges 
TCP FIN.ACK.FIN.ACK 284B data packets with the proxy 
server 270. The proxy server 270 immediately replays these 
data packets to the node server 274 as TCP FIN.ACJCFI- 
N.ACK 284A data packets. 

35 It is important to note that the present invention only 
employ the proxy server 270 to buffer and store data packets 
until the HTTP request is received. Once the HTTP request 
is received, the proxy server will replay all of the buffered 
data packets for the selected node server 274 and switch to 

40 a forwarding mode for subsequent data packets, i.e., the 
proxy server will immediately replay all subsequent data 
packets transmitted by the client 272 to the selected node 
server. 

4S System Configuration 

FIG. 9 illustrates a system for the client 10 comprising 
components of a computer suitable for executing an appli- 
cation program embodying the present invention. In FIG. 5, 
a processor 12 is coupled bi-directionally to a memory 14 

50 that encompasses read only memory (ROM) and random 
access memory (RAM). ROM is typically used for storing 
processor specific machine code necessary to boo tup the 
computer comprising client 10, to enable input and output 
functions, and to carry out other basic aspects of its opera- 

55 tion. Prior to running any application program, the machine 
language code comprising the program is loaded into RAM 
within memory 14 and then executed by processor 12. 
Processor 12 is coupled to a display 16 on which the 
visualization of the HTML response discussed above is 

60 presented to a user. Often, programs and data are retained in 
a nonvolatile memory media that may be accessed by a 
compact disk-read only memory (CD-ROM) drive, compact 
disk-read/write memory (CD-R/W) drive, optical drive, 
digital versatile disc (DVD) drive, hard drive, tape drive and 

65 floppy disk drive, all generally indicated by reference 
numeral 18 in FIG. 9. A network interface 22 couples the 
processor 12 to a wide area network such as the Internet. 
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As noted above, the present invention can be distributed 
for use on the computer system for the client 10 as machine 
instructions stored on a memory media such as a floppy disk 
24 that is read by the floppy disk drive. The program would 
then typically be stored on the hard drive so that when the 5 
user elects to execute the application program to carry out 
the present invention, the machine instructions can readily 
be loaded into memory 14. Control of the computer and 
selection of options and input of data are implemented using 
input devices 20, which typically comprise a keyboard and to 
a pointing device such as a mouse (neither separately 
shown). Further details of system for the client 10 and of the 
computer comprising it are not illustrated, since they are 
generally well known to those of ordinary skill in the art. 
Additionally, although not shown, computer systems for the is 
node server 120 and the server array controller 118 could be 
configured in substantially the same way as the computer 
system for the client 10 illustrated here, albeit different in 
other ways. 

20 

Cookie Types 

It is further envisioned that other types of Cookies may be 
used to identify a path that would be used to exchange data 
packets between the client and a destination such as a host 
machine, firewall, router or a node server managed by a 
server array controller. A "path" type of Cookie could be 
used to indicate the actual route and interim destinations that 
the data packets must use to travel between the client (source 
side) and the destination (supply side). For example, the path 
Cookie could indicate the individual routers that must be 
used to send data packets containing the HTTP requests 
and/or HTTP responses between the client and the destina- 
tion. 

A "hops" type of Cookie could be used to indicate an 
intermediate destination in the route the data packets must 
use to travel between the client and the destination. For 
example, a hops cookie could indicate a particular router that 
must always be used to send data packets containing the 
HTTP requests and/or HTTP responses between the client 
and the destination. 

A "priority" type of Cookie may be used to indicate a 
priority for processing a data packet containing an HTTP 
request ahead of other data packets. Also, each priority 
Cookie could include a range of values indicating a level of 4S 
priority. In this way, a data packet containing an HTTP 
request and a priority Cookie with the high priority value 
would be processed (sent) ahead of other data packets that 
contained HTTP requests and lower priority Cookies. 

A "load balancing" Cookie could be used to indicate the 
load balancing method that the server array controller should 
perform to select the optimal node server to provide access 
to the resources when an HTTP request does not include a 
current Cookie with information identifying a destination. It 
is also envisioned that multiple types of Cookies and infor- 
mation could be included in HTTP requests and HTTP 
responses. 

Additionally, it is envisioned that a unique identification 
of a client or a destination may be represented as encoded 
information in the Cookie. The result of an equation or a 
hash value or may be used to encode the destination 
uniquely identified in the Cookie. A hash value (or simply 
hash) is a number generated from a string of text. The hash 
is substantially smaller than the text itself, and it is generated 
by a formula in such a way that it is extremely unlikely that 
some other text will produce the same hash value. Generally, 
the sender generates a hash of a message, encrypts the hash, 
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and sends it with the message itself. The recipient then 
decrypts both the message and the hash, produces another 
hash from the received message, and compares the two 
hashes. If they're the same, there is a very high probability 
that the message was transmitted intact. A hash provides a 
quickly determinable value in the Cookie for identifying a 
relationship between the client and the destination. 

An exemplary equation for directly determining the ip 
address of a selected node server (N) is as follows: 

ip4«N % 256; 

ip3-<(N-ip4)/256)% 256; 

i P 2K(N-ip4-ip3*256)/(256*256)% 256; 

iplK(N-ip4-ip3*256-ip2*256*256)/(256*256*256))% 
256; 

Where the ip address for N»ipl*256* 256*256+ 
ip2*256*256+ip3*256+ip4. 

While the preferred embodiment of the invention has been 
illustrated and described, it will be appreciated that various 
changes can be made therein without departing from the 
spirit and scope of the invention. 

The embodiments of the invention in which an exclusive 
property or privilege is claimed are defined as follows: 

1. Method for load balancing access to a resource iden- 
tified in a hyper text transport protocol (HTTP) request, 
comprising: 

(a) examining an HTTP request to determine when a 
Cookie is included with the HTTP request, the Cookie 
including information that indicates a destination for 
accessing the resource identified in the HTTP request; 

(b) when the Cookie is included in the HTTP request, 
sending the HTTP request to the destination that is 
indicated by the Cookie's information; 

(c) generating an HTTP response at the destination, the 
HTTP response providing access to the requested 
resource; 

(d) inserting a copy of the information in the Cookie into 
the HTTP response; 

(e) sending the HTTP response with the copy of the 
information in the Cookie to the sender of the HTTP 
request, so that a subsequent HTTP request to access 
the resource will include another Cookie with informa- 
tion indicating that the resource is accessible at the 
destination; 

(f) sending the HTTP request to a server array controller 
that manages a plurality of node servers; 

(g) employing the server array controller to select one of 
the plurality of node servers to receive the HTTP 
request based on the information in the Cookie, the 
selected node server being associated with the 
destination, wherein the selected node server generates 
the HTTP response; 

(h) including an identifier with the copy of the informa- 
tion in the Cookie, the identifier associating the 
selected node server with the destination; 

(i) generating a time stamp that is included in the HTTP 
response; and 

(j) changing an expiration date for the time stamp relative 
to the number of HTTP requests sent to the server array 
controller over a period of time. 

2. The method of claim 1, wherein the expiration date for 
the lime stamp is increased when the number of HTTP 
requests sent to the server array controller are greater than a 
determined value over the period of time. 

3. The method of claim 1, wherein the expiration date for 
the time stamp is decreased when the number of HTTP 
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requests sent to the server array controller are less than a 
determined value over the period of time. 

4. Method for load balancing access to a resource iden- 
tified in a hyper text transport protocol (HTTP) request, 
comprising: 

(a) examining an HTTP request to determine when a 
Cookie is included with the HTTP request, the Cookie 
including information that indicates a destination for 
accessing the resource identified in the HTTP request; 

(b) when the Cookie is included in the HTTP request, 
sending the HTTP request to the destination that is 
indicated by the Cookie's information; 

(c) generating an HTTP response at the destination, the 
HTTP response providing access to the requested 
resource; 

(d) inserting a copy of the information in the Cookie into 
the HTTP response; 

(e) sending the HTTP response with the copy of the 
information in the Cookie to the sender of the HTTP 
request, so that a subsequent HTTP request to access 
the resource will include another Cookie with informa- 
tion indicating that the resource is accessible at the 
destination; 

(f) including a plurality of Cookies in the HTTP request, 
each Cookie having a different type; and 
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(g) determining a type for each Cookie, the type of each 
Cookie indicating how the information included in each 
Cookie is to be utilized, wherein the type of each 
Cookie includes priority, path and hops. 
5 5 . The method of claim 4, wherein the path type of Cookie 
includes information indicating all of the interim destina- 
tions between the sender and the destination, the interim 
destinations including a router, host machine, server array 
controller, firewall, node server and client. 
10 6. The method of claim 4, wherein the hops type of 
Cookie includes information indicating at least one interim 
destination between the sender and the destination, the 
interim destinations including a router, host machine, server 
array controller, firewall, node server and client. 
15 7. The method of claim 4, wherein the priority type of 
Cookie includes information indicating when the HTTP 
request and the HTTP response is to be processed prior to the 
processing of another HTTP request and another HTTP 
response. 

20 8. The method of claim 4, further comprising including an 
indication in the information that identifies a priority for 
processing the HTTP request and the HTTP response prior 
to the processing of the other HTTP request and HTTP 
response. 

25 

***** 
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